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Abstract 

We study some measures which are related to the notion of the e-complexity. We prove that measure 
of e-complexity defined on the base of the notion of e-separability is equivalent to the dual measure that 
is defined through e-nets. 
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1 Introduction 

The problems under consideration in this article were originated in the process of study of complexity 
of behavior of orbits in dynamical systems. While symbolic complexity (see, for instance |1]) deals with 
symbolic systems and topological complexity (|2]) reflects pure topological features of dynamics, the 
e-complexity depends essentially on a distance in the phase space (see definition bellow). If one has a 
dynamical system generated by a continuous map / : X — > X where X is a metric space with a distance 
p, one can introduce the sequence of distances 

p n {x,y)= max p(fx,fy), n G N, 

0<i<n— 1 

and study the e-complexity with respect to the distance p n as a function of "time" n. This function 
reflects the evolution of instability of orbits in time [Q. But to study it in details, one needs to know 
more about general properties of the e-complexity of a metric space (without dynamics). 

The goal this article is to introduce and study quantities which contain an essential information 
about e-complexity, the measures of e-complexity in an "abstract" metric space. The main results will 
be related to the e-complexity defined on the base of the notion of e-separability. The notion was used 
first by Kolmogorov and Tikhomirov [5j in their study of solutions of PDE and realization of random 
processes (Shannon suggested to pay attention to this notions in 1949, though). We will also study 
e-complexities based on the notion of e-nets. We prove that measure of e-complexity defined on the base 
of the notion of e-separability is equivalent to the dual measure that is defined through e-nets. 

It appeared naturally that some results and ideas from discrete mathematics are worth to be ex- 
ploited. We believe that we made the first step in this direction. 

2 Set-up and definitions 

2.1 Separated sets and complexity 

Let X , d be a compact metric space with a distance d. 

Definition 1 1. Given e > 0, a set Y C X is e-separated iff for any different x,y £ Y one has 
d(x,y) > e. 

2. The number 

C t (X,d) — C t := max{|F|, Yis an e-separated set}, 
where | ■ | denotes the cardinality of a set, is called the e-complexity of X. 

3. An e-separated set Y is optimal iff \Y\ = C E . 
Let us show the following natural inequality. 
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Proposition 1 Given A, A C X and e > one has 

C e (A U A) < C £ (A) + C £ (A). 

Proof. Let Y C A U A be an optimal e-separated set in A U A • Then Yi — Y fl A is an e-separated 
set in A and |Y| < |yr| + |y 3 | < C e (A) + C* e (A). □ 
Remark. 

Invariant sets in dynamical systems can be treated as results of inductive procedures. For example, the 
dynamical system generated by the map / : R — > R, 



/(*) 



3x, x < 1/2, 

3a; -3, x > 1/2, 



has an invariant set if containing all orbits belonging to the interval [0, 1]. One can see that K is the 
one-third Cantor set, so that 

00 

#=n u ^-i-i. 

n=l (i ...i n _i) 

where ij G {0, 1}, Ai ...i„_ 1 are intervals of the length 3 _n arising on the n-th step of construction of 
the Cantor set. Therefore, if e ~ 3~" then C £ ~ 2 n = {the number of different words of length n in the 
full shift with 2 symbols} = e hn , where h = In 2 is the topological entropy of the full shift. Thus, 

lnC e In 2 h 

= dmiff K, 



- In e - In 1 /3 In A 

where dim^f K is the Hausdorff dimension of K and A = 1/3 is the contraction coefficient. We obtained 
the familiar Furstenberg formula [Sj. 

This example shows that if a subset of a metric space is the result of an inductive procedure gov- 
erned by a symbolic dynamical system then the e-complexity contains, in fact, an important dynamical 
information. 



2.2 e-nets and complexity 

In this subsection we give a dual definition of complexity. Given x £ X let O t (x) = {y : d(x,y) < e}, 

the ball of radius e centered at x. Given Y C X let O t (Y) = (J O t {x). 

xeY 

Definition 2 1. Given e > 0, a set Y C X is an e-net iff O e (Y) = X. 

2. The number 

Rt(X,d) = _R E := min{|Y|, Yis an e-net}, 
is called the dual e-complexity of X. 

3. An e-net Y is optimal iff \Y\ = i? e . 

The similar results to the one in Proposition holds for dual complexities. 
Proposition 2 Given A, A — X an ^ e > one has 

R e (Dl U A) < iie(A)+iie(A). 

Proof. Let Yi C A be an optimal e-net in A- Then y = Yi U Yi is an e-net in A U A and 
fl e (AUA) < |Y| < |Yi| + |Y 2 | =i? e (A)+i? e (A). □ 

Any optimal e-separated set is an e net, therefore C e > Re. On the other hand the following statement 
holds. 

Proposition 3 R e /2 > C £ 

Proof. It follows directly from the definition that any pair of different points in an e-separated set 
Z can not belong to a ball of radius e/2. Thus we cannot cover Z by less than \Z\ balls of radius e/2. 
Assuming that Z is optimal we obtain the inequality above. □ 
Let us introduce 

h t = sup R €/2 (Oe(x)). 

x€X 

Obviously, for any D C X one has b e R e (D) > R e/2 (D). It is not difficult to check that 6 E < 2 d (2 d + 1) 
for a subset of the Euclidean space R d . 
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2.3 Ultrafilters 

Now we give some known results and definitions that can be found, for instance, in [Bj. 
Definition 3 A set T C 2 N is called to be a filter over N iff it satisfies the following conditions: 

• If Ae T and B G T, then AC\B eT, 

• If A € J 7 and Ac B then B G T, 

• £ T. 

Let a n be a sequences of real numbers, a is called to be a limit of a n with respect to a filter T, 
a = limjra„, if for any e > one has {n | \a„ — a\ < e} G T. From the definition of a filter it follows 
that linijr a n is unique, if exists. 

Example Let Tf = {A C N | N\A is finite }. Tf is said to be a Frechet filter. One can check that it 
is, indeed, a filter. A limit with respect to Tf coincides with ordinary limit. 

Definition 4 A filter T is called to be ultrafilter iff for any set ACN one has 46 T or N\A G T . 

Theorem 1 A bounded sequences has a limit with respect to an ultrafilter. This limit is unique. 

Example For i € N let Ti = {A C N | i G A}. It is an ultrafilter. Such an ultrafilter is called proper for 
i. One can check that lim^ a n — a%. So, limits with respect to a proper ultrafilter are not interesting. 

Proposition 4 An ultrafilter T is proper (for some i £NJ if and only if it contains a finite set. 

This proposition implies that an ultrafilter is non-proper if and only if it is an extension of the Frechet 
filter Tf- On the other hand, it follows from the Zorn lemma that any filter can be extended to an 
ultrafilter. 

Proposition 5 There is an ultrafilter T D Tf ■ Any such an ultrafilter is non-proper. 

3 Measures of complexity 

Our goal is to define a measure reflecting an asymptotic behavior of the e-complexity as e goes to 0. For 
that we will use the technique of ultrafilters. 

Given e > 0, consider an optimal e-separated set A e . Introduce the following functional 

h{4>) = 7^ E ^ 

° e x6A« 

where <f> : X — » R is a continuous function. It is clear that I e is a positive bounded linear functional on 
C(X). Moreover, for any <j) G C(X) the family I e (^>) is bounded. Fix a sequence E — {e n }, e n — > as 
n — > oo and an arbitrary non-proper ultrafilter T. Consider 

1(4) = lrniI e „W>). 
/ is a positive bounded linear functional on C(X). 

Theorem 2 The functional I ts independent of the choice of an optimal sets A t . 
Proof. The proof is based on the following proposition. 

Proposition 6 Let A and B be optimal e-separated sets. There exists a one-to-one map a : A — > B 
such that d(x,a(x)) < e for any x G A. 

Let A t and B t be optimal e-separated sets, e G E. Let a t : A t — > B t be the map from Proposition^] 
Then 

where r^(e) = sup{|0(a;) — <fi(y)\ '■ d(x,y) < e}, the modulus of continuity of <f). Since X is a compact, 
— * as e — » 0. It implies the desired result due to the choice of the ultrafilter T. So, we need only 
to prove Proposition |B] it will be done below. □ 

In the proof of Proposition |S| we will need the Marriage Lemma of P. Hall, see for instance |10|. 

Lemma 1 For an indexed collections of finite sets Fi, i*2, • • • , Fk the following conditions are equivalent: 

k 

• there exists an infective function a : {1, 2, k} — » (J Fi such that a(i) G Fi; 
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• For all S C {1,2,..., A;} one has \ \J F,\ > \S\. 

Recall that O t (x) — {y : d(x,y) < e}, the ball of radius e centered at x. Given Y C X let 
0«(y) = U Oe(a:). 

Proof of Proposition I^J For any x G A let = O e (x) n B. If we show that for any SC A the 
following inequality holds 

\\JB X \>\S\, (1) 

xes 

then the proposition follows from LemmaQdue to \A\ = \B\ — C £ . To prove inequalities 0, suppose 
that | |J Sal = |O e (5) n B\ < \S\ for some SCA Then 

|5 U (B \ (O e (5) n B)| = |S| + - \O e (S) HB\) > \B\ = C„ 

on the other hand, the set SU (B\ (O e (S i ) PiB) is e-separated. We have a contradiction with optimality 
ofS. □ 

So, we have defined a functional I which may depend on the choice of the sequence E and the 
ultrafiter T only. Sometimes we will write Ie, t to emphasize this dependence. It is well known, that 
Ie,t generate unique regular Borel measure fiE,T on X such that he,t{X) = 1. 

Definition 5 The measures ^e,t{X) will be called measures of complexity. 

We are going to show examples of (X, d) when \ie,t = p is independent on E, T and when \ie,j= depends 
on E,T. In the first case 

I B ,^) = 1(0 = ]im 1,(0. 

e— »0 

Of course, it is difficult to find optimal sets and construct directly measures of complexity in real 
situations. Nevertheless, it is possible to work with them by using some of their intrinsic properties. 
Let us show now that measures of complexity are invariant with respect to local isometries. 

Definition 6 A homeomorphism t : X — » X ts called to be e-isometry iff d(x,y) — d(r(x),T(y)) for all 
x,y G X, d(x,y) <eA homeomorphism r : X — » X is called to be local isometry iff it is e isometry for 
some e > 0. 

It is clear that an isometry is a local isometry. 

Proposition 7 Local isometries with composition form a group. 

Proof. It is easy to check that the composition of two e-isometries is an e-isometry. Let r be an 
e-isometry. Then r _1 is uniformly continuous and there exists e' > such that if d(x,y) < e',then 
d(T^ 1 (x),T^ 1 (y)) < e. Consequently, if d(x,y) < e' then d(x,y) — d(T^ 1 (x),r~ 1 (y)), so, r _1 is an 
e'-isometry. □ 

We do not know if e-isometries form a group. 

Proposition 8 Let r be an eo-isometry and A be an e-separated set, e < eo. Then t~ 1 (A) is also 
e-separated. 

Proof. Assume, on the contrary, that t~ 1 (A) is not e-separated, i.e., there are different x,y € t~ 1 (A) 
with d(x,y) < e < eo. Then d{T{x),r{y)) = d(x,y) < e, so A cannot be e-separated. □ 

Theorem 3 Let r be a local isometry. Then iiE,r is invariant, i.e. (j,e,f{A) = he.t(t~ 1 (A)) for all 
measurable A. 

Proof. It is enough to show that for all <j> G C(X) 

Ir{<t>oT)=Ir{ct>). (2) 

There exists eo > 0, such that r is an eo-isometry. Let A,, be an optimal e-separated set, e < eo. It follows 
from Proposition |H] that r~ 1 (A e ) is an optimal e-separated set. It implies the validity of Equation 
Indeed, 

e i6A, £ i£r-l(A e ) 

and the result follows from Theorem [5] □ 

Corollary 1 Let a continuous group operation * be defind on X such that right shifts r g (x) — g*x (left 
shifts l g (x) = x * g) are local isometries for all g G X. Then \ie,t is the normalized Haar measure on 
(X, *). In particular, fiE.T does not depend on E,T. 
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Example 1. Let X = fl p , the full shift with p symbols, i.e. il p = {0, 1, ...,£> — 1} Z with the distance 

f2 p can be equipped by the group operation © as follows: 

(a; ffi y)i = £Ci + m, mod p 

It is clear that (fi p ,©) is a continuous group. Moreover, the right translation by any element is an 
isometry. Therefore \ie,t = A 1 coincides with the Haar measure which, in fact, is the (1/p, 1/p)- 
Bernoulli measure. 

Example 2. Let X = Qm be a topological Markov chain, defined by a finite matrix M : {0, 1, ...,J> — 
f } 2 — > {0, f }, i.e. = {< io,ii, ... > | Xi G {I, 2, — 1} and M(xi,x i+ i) = f }. Metric d is the 
same as in Example 1. 

Cylinder [ao, at,..., On-i] of the length n is the set of all x G £Im, such that Xi = a% for i = 0, 1, n— f . 
A word < do, ,o«-i > is admissible iff [ao, 02, On— l] 7^ 0- Let W„ be the set of all admissible 
words of the length n and a be a permutation of W n such that (a(w)) n -i = for every w G Wn 

(admissible permutation). Given such an a define g a : X — > X as follows 

g a (a;) = (a(xo,xi,...,a; ra -i), a; n ,a; n +i,...). 

It is simple to see that g a is a local isometry. It implies that fJ.E,T([ao, oi, o«-i]) = [J>E,F([bo, 61, &n-i]) 
if [ao, 01, o n _i] 7^ 0, [60, 61, b n -i] 7^ and a n _i = b„-i. Indeed, under these assumptions 
there exists an admissible permutation a : W n — ► W n such that a(ao, Oi, On-i) = bo, 61, b n -i- 
So, the measure He,j= of a nonempty cylinder [ao, Oi, a n _i] depends only on a n _i and n. Let 
Vi(n) = /Us.^Cfao, Oi, — , On-2,*]) for an admissible < ao,ai, a n -i,i > (vi(n) = if there is no 
admissible words of length n ending by i). It is simple to check that 

v i( n ) = 51 u j( n + 1 ) 

j,Af(«,j')=l 

This relation can be rewritten in the matrix form 

v(n) = Mv(n + 1), 

where v(n) = (vo(n),vi(n), w p _i(n)) T is a column vector. If M is a primitive matrix (M p > for some 
p) then this equation uniquely defines the measure fJ.E,T, which in this case turns out to be independent 
of E, T . Indeed, by Perron Theorem matrix M has unique positive eigenvector e with eigenvalue A > 
(in our case, in fact, A > I). Let P be the set of all lines in R p , generated by non-negative vectors. 
From the proof of Perron Theorem (see, for example, [8J) 

n m-(p) = {z e }, 

nSN 

where l e is a line, generated by e. Since v(n) > and v(k) = M n v(n + k), one has l v (k) G M"(P) for 
any n. Hence, v(k) = c^e. So, v(n) = A~"coe. We have proved the following 

Proposition 9 Let M be a primitive matrix and C C O.M is an admissible cylinder of length n, ending 
by i. Then ^e,t{C) = A _n ei, where (eo, ei, Cp-i) is t/ie positive eigenvector of M, with eo + ei + 
...e p _i = 1. 

Example 3. Here we construct an example where \xe,f is not unique. Let X = Qo,i U ^2,3, where 
Q,i,j is the Bernoulli shift of symbols i,j. We are going to introduce a metric d on X such that \ie,j= 
depends on E.J-. 

Let us define d. For x G fio.i and y G ^2,3 let d(x,y) = 1. For x,y G fio.i, x n 7^ j/ n and a* = y% 
for i < n, let d(x,y) — a n . For x,y £ ^2,3, x n 7^ y„ and = for i < n, let d(x,y) = b n . Suppose, 
1 > ao > ai > ... > a n — > and I > 60 > fei > ... > b n — > 0. Straightforward calculations show that d is 
a metric (even an ultrametric) defining the Markov topology on X. 

Proposition 10 // a r -i > e > a r and b m -i > e > b m then (7 e (f2o,i) = 2 r and C t (yi2,3) = 2 m , t/ie 
cardinality of an optimal e-separated set on Q.0,1 and Q.2,3, correspondingly. 



5 



Proof. Indeed, if, say, x,y £ Ho,i are in the same cylinder of length r, then d(x,y) < a r < e. So, an 
e-separated set does not contain different points of the same cylinder of length r. On the other hand, if 
x,y £ f2o,i are in different cylinders of length r, then d(x,y) > a, — i > e. □ 

Take e n = l/2n and ejj = l/(2n + 1). The idea is to choose a n and b n such that 

c^ovT) and ^ °> (3) 

asn^oo. In particular, we can take b = 1, a(„_i)( 2 (n-i)+i) = 0(„_i)(2(n-i)+i)+i = •■• = a n {2n+X)-i = 

l/2n and & n(2 „-i) = & n (2»-i)+i = ■■• = &(n+i)(2n+i)-i = l/(2n + 1), where ra = 1,2 Now one can 

check that 

1 . , 1 

a n(2n + l)-l — — £n > 1 n (2n + l) and n ( 2n _l)_l > — — C„ > 0«(2n-l) • 

Because of the proposition C en (n ,i) = 2' l(2,I+1) , (7 en (n 2>3 ) = 2 n(2n_1) and the first limit in © occurs. 
On the other hand 

a n(2n+i)-i > 2n 4- 1 = £ " ^ a ' I ( 2,I + 1 ) ^(«+i)(2n+i)— i — 2rT+~l = £ ™ ^ (2n+l) • 

So, C e ^(n ,i) = 2 n(2n+1) and C^^.s) = 2 (n+1)(2n+1) ; the second limit of is valid. Now, for 
E — {l/2n | n £ N} one has He,t{^2,3) = and /Ue,;f|q i is the (1/2, l/2)-Bernoulli measure, 
independently of T. For E' = {l/(2n + 1) n € N} one has /i B /,jr(fio,i) = and ^b',^\si 2 3 is the 
(1/2, l/2)-Bernoulli measure, independently of For _B = {1/n | w £ N} — E \J E' the measure /xj ^ 
will depend on T . 

4 Measures of dual complexity 

To define measures of dual complexity we proceed in the same way as in Section [3J just replacing 
e-separated sets by e-nets. 

Given e > 0, consider an optimal e-net A t . Introduce the following functional 



I'M = i- E 



Consider 



Re 



I{4>) = lim h n {4>). 



Theorem 4 The functional I is independent of the choice of an optimal e-nets A e . 

Proof. The proof is similar to the one of Theorem |5J just instead of Proposition |S| one should use 
Proposition II II formulated below. □ 

Proposition 11 Let A be an optimal e-net and B be an e-net. There exists an injective map a : A — > B 
such that d(x,a(x)) < 2e for any x £ A. 

Proof. Again we will use Marriage Lemma (Lemma 0. For x £ A let 

B x = {y £ B O e (y) n O e (x) ± 0} C 2e (x) n B 

For S C A let 

B s = (J B x . 

As in the proof of Proposition |S| it is enough to show that for any SCi one has 

|B S | > \S\. (*) 
First of all, O e (x) C O c (B x ), x £ A. Indeed, due to O e (B) = X we have 

O e (x) = O e (x) n O e (B) = O e (x) n O e (B x ). 

So, O e (5) C O e (Bs). 
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Now, suppose that \Bs\ < \S\ in contradiction to (*). Then 

L4\SUB S | < \ A\. 

Moreover, O e (A\S) 2 O e (A)\O e (S). Indeed, if z £ O t (A)) and z O e (S) then there exists a £ A such 
that d(a,x) < e; a cannot belong to 5* because z O e (S). Hence, a £ A\S, and z £ € (A\S). Thus 

O t (A\S U B s ) = O e (A\S) U Oc(Bs) 2 O e (A)\O e (S) U O e (B s ) = X^iS) U O e (B s ) = X, 

the contradiction with minimality of A. □ 

Definition 7 The measures ve,t{X) corresponding to Ie.t will be called dual measures of complexity. 

Proposition 12 Let r be an eo-isometry and A be an e-net, e < eo. Then r(A) is also an e-net. 

Proof. Given x £ X we have to prove that x £ O e (r(A)). Due to surjectivity of r there exists y £ X, 
x — r(y). There exists a £ A such that y £ O e (a). By the definition of e-isometry x = r(y) £ O e (r(a)). 
□ 

Using Proposition 1121 Proposition Q one can prove the following analogue of Theorem |3] 

Theorem 5 Let t be a local isometry. Then ve.t is invariant, i.e. ve,t{A) = ve,t{t~ 1 {A)) for all 
measurable A. 

We don't know if (j,e,t and ve,t can be different, but we can prove the following theorem. 

Theorem 6 If there exists k £ N such that for any x £ X and any small enough e > one has 
Cn(O e (x)) < k, then fj, and v are equivalent and, moreover, 

^ve,t{A) < fiE,r(A) < ku E ,r(A) 

for any Borel set ACX. 
It easily implies 

Corollary 2 If d is a ultrametric (i.e. d(x,z) < max{d(x,y),d(y,z)} for any x,y,z £ X) then ve,t = 

Proof. The result follows from the fact that C e (O e (x)) = 1 for any x £ X and any e > 0, so k — 1 in 
the conditions of the theorem. Indeed, for any z,y £ O e (x) one has d(z,y) < ma,x{d(z,x),d(x,y)} < e 
□ 

So, for Example 3 of Section|2]one has ve.t = I^e,^- The measures in Examples 1,2 are also coinside 
because of Theorem |S] 

In our proof of Theorem |S| we will use the following proposition. 

Proposition 13 Let A be an optimal e-net and B be an optimal e-separated set. Then there exists a 
collection {K x } of subsets of B, indexed by elements of A, with the following properties: 

• K x C O e (x) n B for any x £ A; 

• K x 7^ for any x £ A; 

• K x n K y — III for any different x, y £ A; 

• U„ £ a*»=-B. 

Proof. Since B is an e-net, it follows from Proposition llll that there exists an injective map a : A — > B. 
So, we can put a(x) to K x and distribute the points B\a(A) among K x so that K x satisfy the properties 
claimed. (For example, we can order A and put b £ B\a(A) into K x with the smallest x £ A such that 
&GO e (aO). □ 

Proof of Theorem |6] It is enough to show that for non-negative continuous <f> 

- 5.(4) < h(cj>) < M e (ct>) + 3.(4), (4) 

where <5 e (0) is the modulus of continuity of <j>. Let A be an optimal e-net and B be an optimal e-separated 
set. Let K x be the sets of Proposition 1131 From the conditions of the theorem it follows that \K X \ < k 
and R e <C e < kR e . Then 

E^) = E E ^)<Ei^iW x )+^w))^ fc E^)+ c ^w- 

y£B x £Ay£K x igA x eA 
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Thus 

^ E *(v) < E + < ^E ^ + 5 ^)> 

£ yes e iea E xgA 

that proves the right inequality in @. Similarly, 

E *(v) -EE m > E - > E - 

yes a;eAi/e-ff x 16A 

Thus 

^ E > ^ E - s <&) ^ m~ £ 0(:E) " 5e(0) ' 

E yes E xeA 6 xeA 

□ 
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